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Abstract 

, A heat engine is a machine which uses the temperature difference between a hot and 

a cold reservoir to extract work. Here both reservoirs are quantum systems and a heat 
engine is described by a unitary transformation which decreases the average energy 
I/-) , of the bipartite system. On the molecular scale, the ability of implementing such a 

unitary heat engine is closely connected to the ability of performing logical operations 
and classical computing. This is shown by several examples: 

(1) The most elementary heat engine is a SWAP-gate acting on 1 hot and 1 cold 
two- level systems with different energy gaps. 

(2) An optimal unitary heat engine on a pair of 3-level systems can directly imple- 
ment OR and NOT gates, as well as copy operations. The ability to implement this 
heat engine on each pair of 3-level systems taken from the hot and the cold ensemble 

' therefore allows universal classical computation. 

^ ■ (3) Optimal heat engines operating on one hot and one cold oscillator mode with 

different frequencies are able to calculate polynomials and roots approximately. 

(4) An optimal heat engine acting on 1 hot and n cold 2-level systems with different 
level spacings can even solve the NP-complete problem KNAPSACK. Whereas it is 
already known that the determination of ground states of interacting many-particle 
systems is NP-hard, the optimal heat engine is a thermodynamic problem which is 
NP-hard even for n non-interacting spin systems. This result suggests that there may 
be complexity-theoretic limitations on the efficiency of molecular heat engines. 

1 Introduction 

One of the most important consequences of the second law of thermodynamics is the 
statement that the heat energy of a bath with uniform temperature cannot be converted 
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into other forms of energy. Instead, systems with different temperatures are needed. 
Machines using temperature differences between two or several heat reservoirs are 
called heat engines. Here we consider hypothetical heat engines on the quantum scale 
that "extract" energy from a collection of elementary quantum systems with different 
temperatures. An appealing feature of thermodynamic machines on the quantum scale 
is that their relation to information processing devices become more obvious. This is 
already seen in cooling algorithms which have been proposed in the context of NMR 
quantum computing ,fj, where the analogy between initialization of bits and cooling is 
apparent 1 . Another Gedankenexperiment which shows that a memory of a computing 
device can play the role of a thermodynamic reservoir is Szillard's hypothetical engine 
[3] which extracts work from a reservoir with uniform temperature for the cost of writing 
on an initialized memory (the 'cold' reservoir). From a modern point of view, it is 
natural to replace hot and cold reservoirs by quantum registers. By identifying qubits 
with physical two-level systems one obtains well-defined thermal equilibrium states 
which allows the proper definition of 'hot' and 'cold' qubits. After having represented 
hold and cold reservoirs by quantum registers, heat engines which transfer entropy 
from the hot to the cold reservoir are quantum operations and it is straightforward to 
ask for the complexity of these operations compared to the complexity of computing 
steps. This shall be our subject. As the article will show, one can construct many 
instances of molecular systems where heat engines are close to logical operations and 
computing devices. 

First we state more clearly what we mean by "extracting energy" from a physical 
system. 

Definition 1 (Energy Gain of a Unitary) Given a quantum system with Hilbert 
space TL with Hamiltonian H, i.e., a self-adjoint operator H : TL —* TL, and the state 
be a density operator p : TL — ► TL. Then we say that a unitary U extracts energy if and 
only if 

Egain := tr(UptfH) - tr(pH) > . (1) 

Below we will consider "unitary heat engines" where p is the product state p = pa®Pb 
of a bipartite system A, B and pa and pb are thermal equilibrium states with different 
temperatures Ta, Tb, respectively. 

Definition ^ requires some clarification. First of all one has to ask where the energy 
goes. If it is transferred to the environment, the energy extraction will in general not 
perform any useful work. However, we assume that it is transferred to some target 
system which is not explicitly included into the model. Consider, for instance a two 
level system with energy gap E in the excited state |1). Transferring it to its lower level 
|0) releases the energy E. If the process would be implemented by stimulated emission, 
for instance, the energy would be absorbed by the stimulating field mode. We will not 
consider the problem how the released energy could really perform some useful work, 
instead, we we only demand that the unitary process U in ineq. (^Q) lowers the average 

1 This analogy is a basic insight for the thermodynamics of computation and Landauer's principle 
saying that the erasure of of bit of information 'wastes' the energy In 2 kT, where k is Boltzmann's constant 
and T the reference temperature of the bath which absorbs the erased information. 
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energy of the system. It should be emphasized that we only allow unitary transforma- 
tions here instead of general completely positive (CP) trace-preserving operations 4 , 
since it is commonly believed that all processes are unitary provided that a sufficiently 
large environment is taken into account. By allowing general CP-operations one would 
therefore implicitly allow information transfer between the system and its environment. 
The fact that the operation on the whole system involves information processing would 
then be obscured by the restriction to a non-informationally complete subsystem. 

One may be surprised why the target system, i.e., the energy sink (like the field 
mode in the example above), does not explicitly occur in the description. From the 
fundamental point of view one would expect a unitary operation on a system which 
includes the target. The problem is that the thermodynamics in such a model de- 
pends strongly on the assumptions on the physics of the target system. If the latter 
acts not only as an energy sink but also as an entropy sink, the free energy, i.e., the 
thermodynamically valuable energy, is not necessarily increased since the latter is a 
difference between energy and entropy multiplied by the Boltzmann constant and a 
given reference temperature. The latter temperature determines therefore the gain of 
usable energy. 

In [5] we have considered thermodynamic models consisting of a hot and a cold 
system as well as a target system which is driven to a non-equilibrium state by a 
energy conserving transformation on the whole tripartite system. The question, which 
resources are sufficient to prepare a desired non-equilibrium state in the target system 
has extensively been studied in [3] in the context of a quasi-order of thermodynamic 
resources. We will show in Section El that energy conserving transformations on the 
tripartite system can approximately lead to unitary transformations by restriction to 
the hot and cold reservoir if the target system starts in a superposition of many energy 
eigenstates (as a coherent state in quantum optics). This should be considered as 
justification of our model. 

In this paper, we do not consider the question of which physical interactions could 
implement the desired unitaries. It is clearly far away from present technology to 
implement a unitary heat engine in such a way that the energy consumption of the 
implementation is less than the thermodynamic energy yield. The interesting question 
is whether this is a matter of principle or not; if there are fundamental bounds on the 
energy consumption of the required unitaries one should expect similar lower bounds 
for logical operations. At the moment, no fundamental lower bounds are known on 
the energy consumption of a computer [HI El El EH EEU ; likewise we do not know of 
any such bound for heat engines. Nevertheless molecular heat engines extracting the 
full amount of thermodynamically available work from a hot and a cold reservoir could 
involve logical transformation too complex to be feasible. 

2 Unitary Heat Engines 

In order to see that unitary processes on molecular systems with different temperature 
could extract some work we first want to recall thermodynamics of quantum systems 
with discrete energy levels. We will also give another characterization of thermal 
equilibrium states as the only states which do not allow any energy extraction even 
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if arbitrarily many copies are available. The proof of this statement shows that the 
Boltzmann distribution in conventional thermodynamics arises nicely from a geometric 
condition in the high dimensional state space of many particle systems. First we state 
the usual definition of thermal equilibrium ("Gibbs state"): 

Definition 2 (Thermal Equilibrium) 

Let H := Ej\j){j\ be the Hamiltonian with energy levels Ej and energy eigenstates 
\j). Whenever tr(exp(—H/T)) is finite, the thermal equilibrium state jt f or some 
T > is given by 

7T :=e- H / T /tr(e- H / T ) = J2e- E ^ T \j)(j\/E e ~ El/ ^ 

j i 

where we have dropped Boltzmann's constant. For T = oo the density matrix 77 1 is the 
maximally mixed state and for T = a uniform mixture over all ground states, i.e., 
energy eigenstates with minimal energy. 

One can check easily that 77 1 does not allow any energy extraction since the states 
with lower energy are more likely than the states with larger energy. Note that the 
converse statement is not true, i.e., there are states p which differ from all temperature 
states 7t for T £ [0, 00] but for which no unitary lowering the energy exists. However, 
a weaker form of the converse is true: 

Theorem 1 (Copies of Non-Equilibrium States are Energy Sources) 

Let p be a state with p ^ for all T £ [0, 00] which has the additional property that 
not all the probability is concentrated in the ground states. Then there is an n £ N 
such that an appropriate unitary extracts energy from p® n . 

Proof: It is clear that U can only minimize tr(U pU^ H) if U pW commutes with H 
[12] . We may therefore assume that p already commutes with H. Let po, . . . ,Pd-i be 
the eigenvalues of p corresponding to the energy levels Eq, . . . , E^-i- An eigenbasis of 
p®n - g c i ear iy given by all products of n eigenvectors of H. We characterize these basis 
states by vectors / € Z fc with I = (Zi, . . . , Id) and I = . . . , Z^) where lj and lj are the 
number of components being in level j. Their energy difference can be written as an 
inner product in R n : 

^2(l j -l j )E j = (l-l\E). 

j 

Assume first that pj 7^ for all j = 1, . . . , d. The logarithm of the probability ratio of 
the two states can also be written as an inner product; 

^2(lj - lj) Inpj = (I - l\ hip) , 

j 

where 'hip' denotes the vector obtained by taking the logarithm of each entry of p. 
Assume that p is not the equilibrium distribution. Then there exists, by definition, no 
T >0,peR such that 

Pi = e~ E ^ Vj , 



4 



which would be equivalent to 

lnp= --E + pa, 

if we define a G M rf as the vector having only 1 as entries. Let R be the projection onto 
the space a -1 . Then we have 



for all T > 0. Since not all levels have the same energy we have RE ^ 0. Furthermore, 
not all entries of lnp are equal because this would be the T = oo state. Elementary 
geometry shows that there is an x in a 1 - such that 



Of course x can be chosen with rational entries and therefore, by multiplication with 
the least common multiple of their denominators, also as a vector x £ Z d . With such 
an x there exist vectors I, I € Nq such that x = 1 — 1. By defining 



which is equal to the sum of all lj according to I — I _L a, the vectors I, I define two 
classes of states such that each state in one class is more likely than each state in the 
other class although the latter states have less energy. 

Let p have entries zero. Assume that there is some non-zero probability for a level 
which is not the ground state. Then there are 3 levels 0,1,2 with E2,E± > Eq such 
that p2 = 0, p\ 7^ 0. Consider a state with label / in 0® n with I2 = 1, lo = n — 1 and 
lj = for all the other j. Consider furthermore a state with label / where l\ = n and 
lj = for all the other indices j. Clearly there is an n such that 7 has more energy 
than / even though the former has non-zero probability and the latter probability zero. 
□ 

In agreement with thermodynamic intuition, elementary calculation shows that the 
composition pa® Pb of two equilibrium states pa, Pb with the same temperature is the 
unique equilibrium state of the composed system. This shows that the n fold copy of an 
equilibrium state still allows no work extraction. We will clearly expect that if a state p 
is close to an equilibrium state for some T one will require a large number of copies of p 
to extract energy. We will later see that this fact implies that two reservoirs consisting 
of hot and cold two-level systems, respectively, require many-qubit operations whenever 
the temperature difference between the two reservoirs is small. We now define the heat 
engine precisely: 

Definition 3 (Unitary Heat Engine) A heat engine is a unitary transformation 
U on a bipartite system with Hamiltonian H := Ha <8) 1 + 1 <8> Hb- It is initially in 
the state p = pa® Pb where pa, Pb are equilibrium states with different temperatures 
Ta,Tb, respectively and U extracts energy in the sense of Definition^ A unitary U is 
an optimal heat engine if it maximizes E ga i n . 




(x\ lnp) > 



and 



(x\E) > 0. 
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3 SWAP as the Most Elementary Heat Engine 



Classical thermodynamics states that one can in principle use any two systems with 
different temperature to extract work in a Carnot cycle ^3]. For two quantum systems 
this is no longer true if we demand unitary heat engines as in Definition^ If the systems 
A and B are two-level systems with equal energy gap E but different temperatures 
Ta,Tb one checks easily that the 4 states 00,01, 10, 11 of the bipartite system already 
satisfy poo > PiojPoi > Pn- Therefore no work extraction is possible since this order 
coincides with ordering the states according to their energy: Eqq < E^i = -Ei,o < -^n- 
However, we can construct a heat engine if the energy gaps Ea and Eb of system A 
and B satisfy 

^i>^. (2) 
E A E B K ' 

One observes easily that the state 10 has more energy than 01 even though the latter 
is more likely due to 

= e -E A /T Ae E B /T B = e (E B /T B -E A /T A ) 

P01 

That the latter term should be greater than 1 leads directly to Eq. (J2J). Then we can 
gain energy by implementation of the SWAP-gate, i.e., the permutation 10 <-> 01. The 
condition © is specific to our molecular heat engine and seems not to be directly related 
with the second law. It is something like an additional constraint for microphysics; such 
constraints become less relevant in larger systems. 

It is easy to see that the SWAP gate is the only possible unitary operation that 
extracts an maximal amount of energy since it is clear that the states 00 and 11 must 
remain unchanged as they already have both extremal energy and probability. Only for 
the two states 10 and 01 the order corresponding to increasing energy is not consistent 
with the order corresponding to decreasing probability and we must exchange the 
states. 

One could easily think of transformations U which are close to the unique optimal 
one. It is intuitively obvious that one could find some trade-off relations between 
efficiency of the heat engine U and its reliability as a SWAP gate. This trade-off 
relation would also hold if convex sums of unitaries (a "random unitary heat engine" ) 
were applied. 



4 Approximate Computation of Roots and Pow- 
ers with Oscillator Modes 

To show that heat engines may involve quite complex transformations we have to 
consider larger systems. A very natural system in physics is a quantum harmonic 
oscillator. Its Hilbert space / 2 (No) is spanned by the number states |0), |1), |2), . . . 
with 0,1,2,... quanta. Such a system can be a quantum optical mode or a mechanical 
oscillator. A state with j quanta of frequency u> has the energy E(j) = jfkv and the 
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system Hamiltonian is therefore 



oo 



H:=hu,Y,3\m- 



3=0 



The bipartite system on which our heat engine will be defined consists of two modes 
with different frequencies to a arid u>b- In studying optimal heat engines on such a 
bipartite system a problem specific to infinite systems will arise: We have usually 
constructed the optimal heat engine U by forming two lists, one containing the basis 
states ordered by decreasing probability and the other by increasing energy. Then U is 
given by the map \a) \b) for each corresponding pair (a, b). Unfortunately the first 
list may be incomplete even though the other is complete. Then U is not defined on 
all states. This situation occurs in the zero-temperature case. Then for every bijection 
on the basis states there is always a bijection extracting more energy. Below we will 
ignore this problem because one can easily check that the maps described there can be 
approximated by unitary heat engines in an appropriate way. 

First we assume u>a = ^>B = w and Ta ^ Tb = 0. Then the only states with 
non- vanishing probability are of the form 



To construct the image of the state |n, 0) with respect to an optimal heat engine we 
recall that the eigenspace of the joint Hamiltonian 



is degenerate. Since u is irrelevant in the following we assume Hlu = 1 such that we 
obtain No as the spectrum. The eigenspace TCk corresponding to eigenvalue k G No 
has dimension k + 1. The optimal heat engine U has to map the state |n, 0} into an 
eigenspace Hk where k is uniquely specified by the following conditions: 



n, 0) n G N . 



H <g) 1 + 1 <g) H 



dim((Bi<k7~(-l) < n + 1 



and 



dim{®i<kHi) > n + 1 . 



By calculating the dimensions we obtain 




fc-i 



fc 



,2 



1=0 



1=1 



and 




1=0 



The conditions are equivalent to 



(k 2 + k)/2 < n + 1 < (k 2 + 3k + 2)/2 . 
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For large n we have k « \Jn. Hence we have a calculator which reduces the approxima- 
tive computation of y/n to an addition of numbers by the following procedure: Apply 
the heat engine to the state |n, 0) and measure n, fh of the resulting state. Then n + m 
is an estimation for \Jn. 

Two modes can also be used for the calculation of squares. Let ub < coo a with 
some real c > 1. Then choose the temperatures such that Ta = cTb- This implies 
that all states |n, m), \n', m') with n + m = n' + m! have equal probability. The optimal 
heat engine on these two oscillators can compute approximately (n + m) 2 for the input 
n, m whenever the result is sufficiently smaller than c. This is seen as follows: 

For a given pair n,m with n + m = k there is a (k 2 + /c)/2-dimensional space 
for which the eigenvalue of the joint density matrix is greater than the eigenvalue 
corresponding to the state \n,m). This space must be mapped into the span of all 
states |0,m') with fh' < (k 2 + k)/2. The subspace 

®l<kHl 

has to be mapped on the span of all \0,m') with fh' < (k 2 + 3k + 2)/2. When we 
initialize the heat engine to a state \n,m) and measure the right quantum number we 
obtain therefore some fh with 

k 2 + 3k + 2 k 2 + k 

> m > . 

2 ~ ~ 2 

Hence we obtain fh ~ k 2 /2. 

The schemes above generalize in a straightforward way to the computation of higher 
powers and higher roots when more than two oscillators are used. To calculate fcth roots 
we start with 1 hot and k—1 zero-temperature oscillators and to calculate the kth power 
we start with k hot and 1 cold modes where the hot modes have c times larger energy 
gap and the temperatures Ta = cTb are also chosen such that the probability for a 
state |ni, n2, . . . , nfc) is only determined by iV := J2j n j- Then the optimal heat engine 
maps all states with N < c onto a state |0, 0, . . . , N) where iV is an approximation for 
VkN. 

Now we assume that the ratio uja/^b is irrational. This ensures that the Hamilto- 
nian of the composite system is non-degenerate. Up to irrelevant constants, the energy 
of a state with quanta in mode A and ns quanta in mode B is 

E(nA,n B ) = rn A + n B 

with r G R \ Q. We define a bijective function k : Nq — > No such that k(nA,ns) 
indicates the number of the pair (n^, ng) when all pairs are put into an increasing 
order with respect to E(nA,riB)- Now we choose the temperatures ^ Ta ^ Tb ^ 
such that 

. = Ea/Ta 
Eb/Tb 

is also irrational which holds for instance when Ta/Tb is rational. It follows that the 
density operator pa® Pb is also non-degenerate. Up to additive and multiplicative 
constants, the logarithm of the probability for a state \ua) <8> \ns) is given by 

Q(n A ,n B ) := qn A + n B ■ 
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A larger value Q{nA,nB) indicates that the state is less likely. In analogy to the map 
k we define a bijective function I : N 2 , — > iVo indicating the order of the pairs (ha,tib) 
with respect to their values Q{nA,ns)- Define a permutation it on Nq by 

7r := k o l^ 1 . 

This permutation of basis states \nA,ns) defines a unitary U n by linear extension 2 . 
The density operator of the whole system after having implemented the heat engine 
U n is 

U n ( PA ® Pb)uI. 

The heat engine permutes the eigenvalues such that they are reordered according to 
the corresponding energy values. We have computed the corresponding reordering of 
states for the values q = y/2 and e = The mapping is depicted in Fig. El showing 

that the heat engine defines a quite complex flow in the discrete two-dimensional plane. 

Another interesting case is when one temperature is zero. For Ta = only states 
\0,ub) have non-zero probability. Here the number ub indicates already the ordering 
of all states which have non-zero probability. The optimal heat engine would have 
to map (0, ub) onto the state (n,A,nB) with fc(n^,ns) = ns- Hence the heat engine 
solves the computation problem of inverting k. 

5 Converting between Different Number Sys- 
tems with TV-Level Systems 

The heat engines above could only be used for approximate calculations. Here we 
present an example with some finite dimensional systems which perform an exact com- 
putation. Consider two iV^-level systems with temperature Ta and two iV^-level sys- 
tems with temperature Tg = 0. Let all 4 systems have equidistant energy levels where 
the first system of type A has energy gaps Ea and the second NaEa- For the iV^-level 
systems we have energy gaps Eb and NbEb and assume furthermore NbEb < Ea- 
Then the N B states with least energy are given by 

|0, 0) (g) \h, rh) , 

where the rightmost vector denotes the states of the two -/V#-level systems. The energy 
is increasing according to an increase of uNa + rh. The N\ most likely states are given 
by 

|n, m) (8> |0, 0) , 

and their probability is decreasing with increasing uNa + m. It is easy to check that 
the optimal heat engine for this level spacing and this temperature configuration can 
convert natural numbers from the iV^-ary representation to the iV^-ary representation: 
Initialize the system to the state 

\n, in) (g) |0, 0) , 

2 Note that the ordering of pairs given by E or Q is a term order in the sense of ^3 
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Figure 1: Optimal heat engine of two harmonic oscillators with frequency ratio oja/^bV? and 
temperature ratio Tb/Ta = V3lob/^a- An arrow (n, m) — ► (h,rh) indicates that a state with n 
quanta in mode A and m in mode B has to be converted into a state with n, rh quanta, respectively. 
Points which have their image or pre-image outside the depicted area obtain no arrow. 
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Figure 2: Heat engine with 3 two-level systems with equal energy gap. 



such that uNa + m < N B — 1 . Then we obtain a state 

|0, 0) (g> \h, rh) 

such that nNs + rh = uNa + m, i.e., the representation of the input number in the 
A^-system. The scheme generalizes canonically to numbers with more than 2 digits 
but since the energy gaps grow exponentially this would not be useful to transform 
numbers with many digits. Nevertheless the example shows that optimal heat engines 
could perform some useful calculations. 



6 Computer Scientist's Heat Engine 

Note that a system with two oscillator modes can never be an efficient computer 
even though it may perform some useful computations since the energy resource re- 
quirements for representing an n bit input increases exponentially with n instead of 
increasing only polynomially. Therefore n qubits are more natural in order to study 
whether implementation of heat engines is close to computing. The heat engine with 
two 2- level systems studied in Section El requires different energy gaps. One can easily 
conclude from Theorem ^ that heat engines are also possible with two-level systems 
with equal energy gap if one has a few of them: The composition of 2 two-level systems 
with temperatures Ta ^ Tb 

p := 7T A ® 1T B 

is not an equilibrium state for any temperature. Therefore, there is an n such that 
p® n allows a unitary heat engine. If the temperatures differ sufficiently this is already 
true for n = 2. One can even implement an heat engine with 2 hot and 1 cold system. 
Assume Ta > 2Tb- One checks easily that the state 110 is more likely than 001 even 
though its energy is twice as much. Hence the process 110 <-» 001 extracts some energy. 
Fig. El shows a quantum circuit implementing this heat engine. 

The required number of systems which are necessary in order to make a heat engine 
possible at all increases whenever the temperature quotient gets closer to 1: 

Theorem 2 (Complexity of Using Small Temperature Gaps) 

A heat engine on ua hot and ub cold qubits with temperatures Ta and Tb, respectively, 
and equal energy gaps, is possible if and only if 

1. (for n A < n B ) 

Ta > n A 
T B ~ n A - 1 
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2. (for n A > n B ) 

Ta > n B + l 
T B ~ n B 

Furthermore, every heat engine acting on an infinite reservoir of hot and cold qubit 
level systems must use operations which connect at least ua hot and n B cold systems 
such that the above conditions hold. 

Proof: We note that a heat engine can work if and only if a pair of states exist such 
that the first has more energy even though it is more likely. Let (I a ,Ib) denote the 
Hamming weights of a basis state in the ua + n B qubit system. The pair (I a, Ib) an d 
{Uai k B ) satisfies this condition if 

(l A - k A ) - (Ib -k B )>0 

and 

(l A - k A )T A - [l B - k B )T B < 
Elementary computation shows that this implies 

Ta I a ~ k A 1 
T B l B - k B 

Clearly the modulus of the numerator and the denominator are at most ua and n B , 
respectively. The smallest possible quotient which is still greater than 1 is therefore 
n-A/^n-A — 1) or (n B + l)/n B , respectively. This shows that the conditions (1), respec- 
tively (2) are necessary in order to make a heat engine possible. 

For the converse we observe that in case (1) a permutation of the states (ua,0) 
and (0, ua — 1) extracts some amount of energy. In case (2) one extracts energy by 
permuting (n B + 1,0) and (0, n B ). 

Fig. |H1 illustrates how the complexity of heat engines on two-level systems with equal 
energy gap increases when the temperature gaps decrease in the sense that more qubits 
have to be involved. Note that Fig. furthermore sketches a simple method to obtain 
suboptimal heat engines on many particles by independently applying few-qubit heat 
engines. 

We would like to know how this increase of complexity with decreasing temperature 
difference occurs also with respect to the number of required gates in a circuit which 
consists of simple elementary gates. Therefore we have checked which heat engines 
are possible when only a few number gates are allowed and restricted the attention to 
TOFFOLI gates |15j since (1) they permute only basis states and can therefore easily be 
treated with computer algebra systems (2) they are universal for classical computation 
and they seem therefore sufficiently powerful to generate good heat engines 3 . The 
restriction to one type of gate simplifies the complete search for all circuits which can 
be obtained with k gates. In the first experiment we consider 3 hot and 2 qubits with 
temperatures Ta = E/\n2 and T B = 0. The probabilities for the upper state is hence 

3 Note, however, that TOFOLLI gates do not generate the full group Sn of permutations on N = 2™ basis 
states of n qubits (see Section |7J). 
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Figure 3: Heat engines with Ta/Tb > 2 can be implemented with joint operations on 2 hot and 1 
cold qubit (left). For 2 > Ta/Tb > 3/2 operations on 3 hot and 2 cold qubits are needed (middle), 
and heat engines for 3/2 > Ta/Tb > 4/3 must involve 4 hot and 3 cold qubits (right). 
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Figure 4: (left:) The simplest possible heat engine which uses only Toffoli gates, (right:) A heat 
engine with 4 gates can extract work from reservoirs with smaller temperature gaps. 



for a hot qubit given by 1/3. Computer algebra calculations have shown that 3 gates 
are necessary in order to have positive energy gain. The circuit Fig. El left, acts on only 
3 + 1 qubits and does not make use of the second available cold qubit. With this circuit 
we have E ga i n = 1/27 which is considerably less than the optimal heat engine on 3 + 2 
qubits having E ga i n = 5/27. If we increase the temperature of the cold system such 
that Tb = E/ha.5 the circuits with 3 gates do not decrease the average energy any more 
and at least 4 gates are needed for a heat engine. One possibility with 4 gates is shown 
in Fig. El right, with E ga i n = 1/72. For temperature Tg = E/ln4 there is even no heat 
engine with 5 Toffoli gates. Note that a heat engine is possible by Theorem because 
Ta/Tb = In 4/ In 2 = 2 > 3/2; therefore the state exchange | 111) (8) |00) <-> |000) O |11) 
extracts energy. Computer algebra calculations show furthermore that there is indeed 
a circuit with 31 Toffoli gates which implements the state exchange above such that all 
the other states are mapped onto basis states with the same Hamming weight. There 
are probably much simpler circuits but we know that at least 6 are required. 
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7 MAJORITY Gate on 2n+l Qubits 



Here we present an example where the complexity of the optimal heat engine can be 
compared to the complexity of a circuit which computes a well-known boolean function. 
Consider 2n two-level systems with temperature Ta = oo and 1 system with Tb = 0. 
The basis states of the system are binary words of length 2n + 1. The joint Hamiltonian 
of the system is given by 

H:=EY,wgt(b)\b)(b\, 

b 

where E is the energy gap of each two-level system and wgt(b) denotes the Hamming 
weight of the binary word b. Let the suffix of each of this binary words indicate the 
state of system B. Then all binary words with suffix have probability 1/2" and 
words with suffix 1 never occur. Every optimal heat engine U has to map the subspace 
spanned by the former 2™ words onto the subspace corresponding to the 2 n smallest 
eigenvalues of H. It is the space spanned by all words with Hamming weight at most 
n. Therefore the inverse of the heat engine, i.e., U~ l computes the boolean function 
MAJORITY in the sense that the rightmost qubit in the state 

U~ l \b) 

is 1 if and only if wgt(b) > n, i.e., the majority of the qubits are in the 1 state. We 
would like to estimate the gate complexity of U when it is implemented by elementary 
gates. If the set of elementary gates contains with every gate also its inverse the 
complexity of U and U~ 1 coincide. To obtain a lower bound on the circuit complexity 
we could therefore use bounds on the circuit complexity of MAJORITY. In ^B] one can 
find bounds for classical circuits with bounded depth which consist of AND and OR 
with arbitrary fan-in. We can give a lower bound on the circuit depth which holds for 
arbitrary /c-qubit gates. The observable which measures whether the suffix of a binary 
word is 1 or is A := \i n (g) a z . It is obviously a 1-qubit observable. The observable 
UAU' which measures whether the majority of qubits are 1 is a 2n+ 1-qubit observable. 
In we have argued that a circuit of depth I can convert a 1-qubit observable at 
most into a fc'-qubit observable. Therefore we otain 

I > log k (2n + 1) 

as lower bound on the depth. This shows after all that the depth must necessarily 
increase with n even though logarithmic growth would be quite slow. We summarize: 

Theorem 3 (Lower Bound on the Depth) 

Let U be an optimal heat engine on 2n two-level systems with temperature Ta ^ and 
one two-level system with Tb = where all 2n + 1 systems have the same energy gap. 
Then the implementation of U with k- qubit gates requires at least a circuit of depth 
log fc (2n + l). 

Note that no ciruit which consists only of NOT and CNOT can implement U. The 
action of CNOT permutes the basis states of two qubits according to 

\a\) (8> |a 2 ) h-> |oi) ® \ai © a 2 ) . 
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If one identifies the pair (ai, 02) with a vector in a two-dimensional space over F 2 CNOT 
is a i^-linear map. By embedding the action of CNOT into a 2n + 1-dimensional space 
over F2 it remains linear. The action of NOT on qubit j corresponds to adding the 
vector . . . 010 ... with 1 at position j. Therefore every circuit V with CNOT and 
NOT gates acts as 

V\b) = \Ab + c), 

where A is a 2n + 1 x 2n + 1-matrix over F2 and c a vector in i ? 2 2n+1 . If the majority 
function would be affine it could up to an additive constant be written as an inner 
product over F2, i.e., there existed a vector v and a number w € F2 such that (v\b)®w 
is 1 whenever wgt(b) > n. This is certainly not the case. It is also easy to see that 
TOFFOLI gates alone cannot be sufficient to implement U or U . Otherwise U and 
U^ 1 would leave all binary words with Hamming weight at most 1 invariant. But 
the state |0 . . . 01) has to be mapped into the space spanned by words with Hamming 
weight greater than n. 

The insight that the inverse of U would compute MAJORITY gave some hints on 
its complexity, however it does not show that the heat engine itself can be used for 
computing this boolean function. A thermodynamic machine which can directly be 
used as a MAJORITY gate is the reverse of the heat engine, namely a refrigerator. 
Assume we have given 2n + 1 two-level systems with the same temperature T / 0, 00. 
Then an optimal refrigerator for the rightmost qubit is a transformation U which 
reduces the probability for its upper state as much as possible. This is certainly the 
case only when U maps all states \b) with wgt(b) > n to the subspace S spanned by 
words with suffix 1 and all with wgt(b) < n to the orthogonal complement of S. Hence 
the rightmost qubit is the output qubit of a MAJORITY computation. We summarize: 

Theorem 4 (Relation to Complexity of MAJORITY) 

Let U be an optimal heat engine on 2n two-level systems with temperature Ta 7^ and 
one two-level system with Tb = where all 2n + 1 systems have the same energy gap. 
Then the implementation of U requires at least as many elementary quantum gates as 
a computation of the function MAJORITY of the 2n + 1-qubit input requires which 
uses no additional memory space. 

8 Universal Classical Computation on Pairs of 
3-Level Systems 

It is clear that every optimal heat engine on 2 two-level systems leaves the states 00 and 
11 invariant because they are the states with minimal and maximal energy and with 
maximal and minimal probability, respectively, at the same time. Therefore the only 
non-trivial logical operation is a SWAP-gate. To find more interesting logical gates in 
a heat engine on a bipartite system we will therefore consider two 3-level systems A 
and B. We assume that system A and B have both equidistant levels |0), |1), |2) with 
energy gaps Ea and Eb, respectively. Up to an irrelevant factor the energy of a state 
|n, m) with n, m = {0, 1, 2} is given by 

E(n, m) = en + m 



15 



with e := E^/Eg. The inverse logarithm of the probabilities is, up to irrelevant 
additive and multiplicative constants, given by 

Q(n, m) = qn + m 

with q := EaTb/{EbTa). When e and q are not in {1/2, 1,2} the Hamiltonian as well 
as the density matrix of the bipartite system are non-degenerate and the optimal heat 
engine implements a unique reordering of basis states. The following choice of values 
e, q turns out to be useful: setting 1 < e < 2 we induce an order on energy values of the 
pairs n, m which is a refinement of the degenerate order induced by n + m such that 
for pairs with equal n + m preference is given to the pair with smaller m. Explicitly, 
this is the order 00,10,01,20,11,02,21,12,22. With q > 2 the probabilities are in 
the lexicographic order 00, 01, 02, 10, 11, 12, 20, 21, 22. By comparing these orders one 
checks easily that the optimal heat engine implements the map 

00 i — ► 00 (3) 

01 i — y 10 

02 i — ► 01 

10 i — y 20 

11 i — ► 11 

12 i — y 02 

20 i — ^ 21 

21 i — ► 12 

22 i — y 22. 

We will show that the ability to implement this heat engine on every pair of 3-level 
systems consisting of one system of type A and one of type B implies the ability to 
implement classical computation on the collection of these 3-level systems. For doing 
so, we chose the encoding such that the logical states 0, 1 are the states |1) and |2), 
respectively and obtain a universal set of logical operations as follows: 

1. OR from A, B to B: 




Apply U once. One checks easily on tabular (j3J) that the second state is |2) if the 
input is one of the states |12), |21), 1 22} and |1) if the input is |11). 

2. WIRE from A to B: 



B 

Use our OR gate by initializing B to |1), i.e., the logical state. 
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3. FANOUT from B to A, B: 



B 



B 



4. 



Initialize system B to |1). Apply U 4 times. We get the mapping 12 20 and 
11 i— > 11. The output on A coincides already with the input on B. The output on 
B is 1 or according to whether the input on B was 1 or 2. Hence the information 
has already been copied to B but with the wrong encoding. For the decoding we 
initialize an additional system A' to the state |1) and apply U 4 to A',B. We get 
10 i — ^ 02 and 11 11. Hence B agrees with the original input on B. 

WIRE from B to A: 



B ' 

Use the FANOUT. 
5. NOT from B to B: 

B B 

Implement the first part of the FANOUT operation which changes the input 
state 2 to and leaves 1 invariant. By Initializing an additional system A' to |2) 
and apply U once we decode and negate the information on B simultaneously: 
20 i — ^ 21 and 21 h-> 12. 

These operations allow obviously universal computation since every boolean function 
can be computed from circuits which consist only of NOR gates. We summarize: 

Theorem 5 (Universal Computing with Heat Engines on 3-level Systems) 

Given two reservoirs of 3-level systems with temperature Ta and Tb and energy gap 
Ea and Eb, respectively, such that 

Ea Eb 

and 

Ea 

2>/>l, 
h,B 

then the ability to implement the optimal heat engine on any chosen pair which consists 
of one system of type A and one of type B implies the ability to implement universal 
classical computation on the 3-level system. 
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9 Optimal Heat Engine as NP-Solver 



So far we have only shown some examples of heat engines which perform relatively 
simple logical operations or computations or heat engines which are generated by some 
simple operations. Now we will consider an instance of a heat engine which had to 
solve a computationally hard problem in order to be optimal. Consider a collection of 
two-level systems with different energy gaps where one them has temperature Ta and 
all the others have temperature Tg. Then the optimal heat engine is a computer which 
solves an NP-complete problem: 

Theorem 6 Let Ea, E\, E2, ■ ■ ■ , E n be the energy gaps ofn + 1 two-level systems. Let 
Ta be the temperature of the Oth system and T of the remaining n. Let the values be 
such that there is no b £ {0, l} n such that 



E A T B 

Let U acting on C 2 (8> (C 2 )® n be an optimal unitary heat engine for this system. Then 
U solves a KNAPSACK problem in the following sense. Measure the right n two-level 
systems with the state 

Z7(|l) O0...0)), 

in the computational basis. Let b E {0, l} n be the obtained result. Then b satisfies 

E A >Y J b j E j >EA^- (4) 
3 

if and only if such a binary word b exists. 

Proof: We only have to show that if there is a string b satisfying (jlj) it will always show 
up as a measured result. Write (b\E) for Y^j=\ bjEj- Intuitively, inequality @ implies 
that the state |0) <8> \b) has less energy than |1) (g) |0) but is less likely. The assumption 
that there is no b 6 {0, l} n such that 

m = ^ 

means that |1) ® |0) is an eigenvector in a non-degenerate subspace. This uniqueness 
of the eigenvalue ensures that the optimal heat engine does not have 'too much choice' 
on which states the state |1) <g> |0) has to be mapped to. 

First consider the subspace TLi spanned by all vectors |0) <g> |c) with (E\c) < 
EaTb/Ta- The restriction of p to this subspace (note that this is indeed an invariant 
subspace of p) is left invariant by every optimal U since the ordering of eigenvalues of 
p and of H coincide here. All these states are more likely than |1) &) |0) and have less 
energy. 

Binary words c with (E\c) = EaTb/Ta do not exist by assumption. Now consider 
the subspace H.2 spanned by all |0) (8) |c) with E A > {E\c) > EaTb/Ta- They have 
less energy than |1) (8 |0) but they are also less likely, i.e., all eigenvalues of p on this 
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subspace are smaller than the eigenvalue p of p for the eigenvector |1) (g) |0). Note that 
Til and H.2 are spectral subspaces of the total Hamiltonian, i.e., the only states with 
energy in the specified intervals are states |0) <S> |c) with c satisfying the considered 
inequalities. Hence every optimal U has to map |1) <S> |0) into Ti.2 since its eigenvalue 
p is the largest one except from the eigenvalues which have already filled the lower 
spectral subspace TC\. □ 

Clearly it is essential for the proof that the heat engine is optimal. Efficient algorithms 
for suboptimal heat engines are possible. Note that it is is a well-known phenomenon 
in the theory of NP-complete optimization problems that a slightly relaxed demand on 
the optimality allows already efficient approximations 18 . To implement a suboptimal 
heat engine one can implement the few-qubit heat engines considered in Section 
involving only some of the qubits in the reservoir B. 



10 Including the Target System 

So far we have considered systems which are informationally closed in the sense that 
only unitary operations are available but which are at the same time not energetically 
closed since it was exactly our goal to extract energy from the system. Our above 
justification for such a model was that we do not want to allow the energy sink to 
absorb entropy because this could trivialize the whole problem. The following paradox 
arises from this justification: The energy extraction in the above unitary heat engines 
is only a probabilistic phenomenon since they decrease only the average energy of 
the system. For some energy eigenstates of the system are mapped onto states with 
higher energy and some onto lower energy states. This implies that the energy of the 
target system is decreased or increased, depending on the state of the system. Such a 
probabilistic change of the energy of the target increases necessarily its entropy even 
though this was exactly what we wanted to avoid. Now we show that there are natural 
situations where this entropy increase is negligible. Let for simplicity the eigenvalues 
of the system Hamiltonian H s be some integers and the energy spectrum of the target 
be Z, i.e., its Hamiltonian Ht on Z 2 (Z) be given by 

Ht\j) =j\j) 

for all j E Z. Let U be some unitary heat engine permuting energy eigenstates of H s 
and (Pj) be a complete set of orthogonal projections on the energy eigenstates of H s . 
Let A(j) be the energy difference between the eigenvalues corresponding to Pj and to 
UPjW and S k be the shift of Z 2 (Z) defined by 

S k \j) = \k + j). 

Then we define a unitary operation V on the joint Hilbert space 
of s and t by 

V:= (U®l)J2Pj®S AU) ■ 

j 
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One checks easily that V commutes with the joint Hamiltonian 

H := H s <g> 1 + 1 ® H t . 

Furthermore, we choose an initial state vector \ip) 6 Z 2 (Z) of the energy sink such that 
(iplS^tp) ~ 1 for all those j which occur as energy difference between initial and final 
state of the system. Then the completely positive positive map G given by 

G(p) :=tr M (V(p®W)&\)Vi) 

coincides almost with the unitary operation p UpU^ . The reason is that a superpo- 
sition of all the eigenstates in a large interval of energy values is insensitive to energy 
increase or decrease and obtains therefore almost no information about the energy gain. 

This shows that the restriction of the energy conserving unitary V to s can indeed 
approximately be the unitary U, when the initial state of the energy sink is a pure state 
with large energy spread. If the Hilbert space of the energy sink is replace by Z 2 (No) the 
construction of unitaries and initial vectors which yield, by restriction, approximately 
the unitary U is technically a bit more difficult. A coherent state in quantum optics 
which has large photon number expectation would be a physical example for a state 
with large energy spread. We conclude that the unitary heat engine appears as a limit 
with macroscopic control fields and is therefore a consistent model. 

The statement that V does not increase the entropy of t by an considerable amount 
holds also when the initial state of t is a mixture of energy eigenstates over a large 
interval of energy values. One checks easily that the restriction of V to s is no longer 
close to a unitary operation. Instead, it destroys superpositions between all those 
energy eigenstates with different A(j). Nevertheless it permutes the basis states in the 
same way as the unitary heat engine U does which implies that it implements the same 
classical computation steps as the unitary model would do. 

11 Conclusions 

Using several examples of toy heat engines we have shown that there is, on the molecular 
scale, a strong coincidence between the task of computation and the task of energy 
extraction from heat reservoirs. The ability to extract a maximal amount of work even 
requires operations for some systems even which solve hard computational problems. 
Even though suboptimal heat engines may in general not require computationally hard 
operations we have argued that work extraction from two-level systems with almost 
equal temperatures require many-qubit operations. We conclude that heat engines 
which extract work from reservoirs with similar temperature require relative complex 
physical processes. 

Clearly, we do not expect that future heat engines on the molecular scale will be 
implemented by the type of gates we have considered. However, the 'Strong Church 
Turing Thesis' ^1 EUl states that any physical device can be simulated by a Turing 
machine in a number of steps polynomial in the resources used by the computing device. 
The quantum version of this replaces the classical Turing machine with a quantum 
Turing machine [2U]. Believing in this principle, one should expect that every process 
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implementing a heat engine which solves an NP-complete problem has an efficient 
simulation on a quantum computer. Provided that one does not believe in efficient 
quantum algorithms for NP-hard problems, our results indicate therefore that there 
are complexity-theoretic limitations to the efficiency of heat engines on the molecular 
scale. 
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